hourly_weather_2022

Dataset statistics

Number of variables	9
Number of observations	17472
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	1.3 MiB
Average record size in memory	80.0 B

Variable types

DateTime	1
TimeSeries	8

Timeseries statistics

Number of series	8
Time series length	17472
Starting point	2022-01-01 00:00:00
Ending point	2023-12-30 23:00:00
Period	1 hour and 5.89 seconds

Original
Scaled

Alerts

`dewpt` is highly overall correlated with `temp`	High correlation
`dhi` is highly overall correlated with `dni` and 1 other fields	High correlation
`dni` is highly overall correlated with `dhi` and 1 other fields	High correlation
`ghi` is highly overall correlated with `dhi` and 1 other fields	High correlation
`temp` is highly overall correlated with `dewpt`	High correlation
`temp` is non stationary	Non stationary
`wind_spd` is non stationary	Non stationary
`dhi` is non stationary	Non stationary
`ghi` is non stationary	Non stationary
`dni` is non stationary	Non stationary
`clouds` is non stationary	Non stationary
`dewpt` is non stationary	Non stationary
`rh` is non stationary	Non stationary
`temp` is seasonal	Seasonal
`wind_spd` is seasonal	Seasonal
`dhi` is seasonal	Seasonal
`ghi` is seasonal	Seasonal
`dni` is seasonal	Seasonal
`clouds` is seasonal	Seasonal
`dewpt` is seasonal	Seasonal
`rh` is seasonal	Seasonal
`dhi` has 8632 (49.4%) zeros	Zeros
`ghi` has 8672 (49.6%) zeros	Zeros
`dni` has 8654 (49.5%) zeros	Zeros
`clouds` has 1036 (5.9%) zeros	Zeros

Reproduction

Analysis started	2024-05-09 08:10:10.402371
Analysis finished	2024-05-09 08:10:32.477693
Duration	22.08 seconds
Software version	ydata-profiling vv4.7.0
Download configuration	config.json

timestamp_local
Date

Distinct	17470
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Memory size	273.0 KiB

Minimum	2022-01-01 00:00:00
Maximum	2023-12-30 23:00:00

Histogram

Histogram with fixed size bins (bins=50)

temp
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL

Distinct	322
Distinct (%)	1.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	18.098094
Minimum	-0.5
Maximum	34.7
Zeros	0
Zeros (%)	0.0%
Memory size	273.0 KiB

Quantile statistics

Minimum	-0.5
5-th percentile	6.7
Q1	12.7
median	18
Q3	24.025
95-th percentile	28.8
Maximum	34.7
Range	35.2
Interquartile range (IQR)	11.325

Descriptive statistics

Standard deviation	6.9540729
Coefficient of variation (CV)	0.38424338
Kurtosis	-0.9045947
Mean	18.098094
Median Absolute Deviation (MAD)	5.6
Skewness	-0.078815103
Sum	316209.9
Variance	48.35913
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.1805122332

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
14.7	217	1.2%
15	196	1.1%
26	194	1.1%
12.2	190	1.1%
14.2	188	1.1%
14	178	1.0%
13.2	176	1.0%
14.5	172	1.0%
15.5	170	1.0%
12.5	168	1.0%
Other values (312)	15623	89.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-0.5	2	< 0.1%
-0.2	1	< 0.1%
0.1	1	< 0.1%
0.2	1	< 0.1%
0.5	5	< 0.1%
0.7	1	< 0.1%
1	3	< 0.1%
1.1	1	< 0.1%
1.5	2	< 0.1%
1.6	4	< 0.1%

Value	Count	Frequency (%)
34.7	2	< 0.1%
34.4	1	< 0.1%
34.2	1	< 0.1%
34	1	< 0.1%
33.8	1	< 0.1%
33.7	2	< 0.1%
33.6	3	< 0.1%
33.5	1	< 0.1%
33.4	1	< 0.1%
33.1	2	< 0.1%

ACF and PACF

wind_spd
Numeric time series

NON STATIONARY SEASONAL

Distinct	133
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.1028028
Minimum	0
Maximum	15.9
Zeros	1
Zeros (%)	< 0.1%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	2.6
median	3.6
Q3	5.09
95-th percentile	8.19
Maximum	15.9
Range	15.9
Interquartile range (IQR)	2.49

Descriptive statistics

Standard deviation	2.1834863
Coefficient of variation (CV)	0.53219382
Kurtosis	1.8332907
Mean	4.1028028
Median Absolute Deviation (MAD)	1
Skewness	1.0922296
Sum	71684.17
Variance	4.7676124
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	3.78182106 × 10^-23

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
3.6	2001	11.5%
3.1	1935	11.1%
4.09	1751	10.0%
2.6	1561	8.9%
4.59	1442	8.3%
2.1	1384	7.9%
5.09	1214	6.9%
1	935	5.4%
6.2	851	4.9%
1.5	847	4.8%
Other values (123)	3551	20.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.25	1	< 0.1%
0.33	1	< 0.1%
0.4	12	0.1%
0.5	203	1.2%
0.72	1	< 0.1%
0.75	1	< 0.1%
0.8	13	0.1%
0.87	1	< 0.1%
1	935	5.4%

Value	Count	Frequency (%)
15.9	1	< 0.1%
15.4	2	< 0.1%
14.4	8	< 0.1%
13.9	9	0.1%
13.4	23	0.1%
12.9	25	0.1%
12.4	3	< 0.1%
12.3	32	0.2%
11.85	1	< 0.1%
11.8	31	0.2%

ACF and PACF

dhi
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	124
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	42.858288
Minimum	0
Maximum	123
Zeros	8632
Zeros (%)	49.4%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	8.5
Q3	91
95-th percentile	118
Maximum	123
Range	123
Interquartile range (IQR)	91

Descriptive statistics

Standard deviation	47.37767
Coefficient of variation (CV)	1.1054494
Kurtosis	-1.5564483
Mean	42.858288
Median Absolute Deviation (MAD)	8.5
Skewness	0.41366257
Sum	748820
Variance	2244.6436
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.9044002042

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8632	49.4%
122	232	1.3%
117	218	1.2%
121	216	1.2%
109	170	1.0%
118	164	0.9%
110	162	0.9%
116	156	0.9%
99	156	0.9%
112	152	0.9%
Other values (114)	7214	41.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8632	49.4%
1	12	0.1%
2	12	0.1%
3	12	0.1%
4	18	0.1%
5	8	< 0.1%
6	18	0.1%
7	10	0.1%
8	14	0.1%
9	20	0.1%

Value	Count	Frequency (%)
123	140	0.8%
122	232	1.3%
121	216	1.2%
120	120	0.7%
119	136	0.8%
118	164	0.9%
117	218	1.2%
116	156	0.9%
115	124	0.7%
114	110	0.6%

ACF and PACF

ghi
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	983
Distinct (%)	5.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	232.08883
Minimum	0
Maximum	991
Zeros	8672
Zeros (%)	49.6%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	3
Q3	437
95-th percentile	878
Maximum	991
Range	991
Interquartile range (IQR)	437

Descriptive statistics

Standard deviation	308.20304
Coefficient of variation (CV)	1.3279529
Kurtosis	-0.33968156
Mean	232.08883
Median Absolute Deviation (MAD)	3
Skewness	1.0316001
Sum	4055056
Variance	94989.115
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.6957092143

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8672	49.6%
64	32	0.2%
370	32	0.2%
894	30	0.2%
1	30	0.2%
869	28	0.2%
191	28	0.2%
2	28	0.2%
770	28	0.2%
991	26	0.1%
Other values (973)	8538	48.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8672	49.6%
1	30	0.2%
2	28	0.2%
3	24	0.1%
4	12	0.1%
5	16	0.1%
6	18	0.1%
7	18	0.1%
8	10	0.1%
9	16	0.1%

Value	Count	Frequency (%)
991	26	0.1%
990	14	0.1%
989	10	0.1%
988	8	< 0.1%
987	6	< 0.1%
986	6	< 0.1%
985	6	< 0.1%
984	6	< 0.1%
983	4	< 0.1%
982	4	< 0.1%

ACF and PACF

dni
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL ZEROS

Distinct	805
Distinct (%)	4.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	349.05357
Minimum	0
Maximum	924
Zeros	8654
Zeros (%)	49.5%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	26.5
Q3	767
95-th percentile	903
Maximum	924
Range	924
Interquartile range (IQR)	767

Descriptive statistics

Standard deviation	380.44115
Coefficient of variation (CV)	1.0899219
Kurtosis	-1.7101447
Mean	349.05357
Median Absolute Deviation (MAD)	26.5
Skewness	0.32548006
Sum	6098664
Variance	144735.47
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.9073866562

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
0	8654	49.5%
893	98	0.6%
915	88	0.5%
914	80	0.5%
857	62	0.4%
920	62	0.4%
870	60	0.3%
913	54	0.3%
919	54	0.3%
892	52	0.3%
Other values (795)	8208	47.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	8654	49.5%
1	10	0.1%
2	4	< 0.1%
3	8	< 0.1%
5	12	0.1%
6	2	< 0.1%
7	2	< 0.1%
8	2	< 0.1%
9	2	< 0.1%
11	2	< 0.1%

Value	Count	Frequency (%)
924	38	0.2%
923	42	0.2%
922	28	0.2%
921	24	0.1%
920	62	0.4%
919	54	0.3%
918	40	0.2%
917	38	0.2%
916	30	0.2%
915	88	0.5%

ACF and PACF

clouds
Numeric time series

NON STATIONARY SEASONAL ZEROS

Distinct	98
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	29.030105
Minimum	0
Maximum	100
Zeros	1036
Zeros (%)	5.9%
Memory size	273.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	12
median	25
Q3	33
95-th percentile	87
Maximum	100
Range	100
Interquartile range (IQR)	21

Descriptive statistics

Standard deviation	22.450243
Coefficient of variation (CV)	0.77334349
Kurtosis	1.4704315
Mean	29.030105
Median Absolute Deviation (MAD)	12
Skewness	1.4343174
Sum	507214
Variance	504.0134
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	4.999463845 × 10^-26

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
25	6233	35.7%
12	3396	19.4%
37	1048	6.0%
0	1036	5.9%
87	1003	5.7%
50	651	3.7%
68	420	2.4%
20	377	2.2%
56	277	1.6%
62	212	1.2%
Other values (88)	2819	16.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1036	5.9%
1	33	0.2%
2	39	0.2%
3	20	0.1%
4	82	0.5%
5	22	0.1%
6	28	0.2%
7	16	0.1%
8	83	0.5%
9	21	0.1%

Value	Count	Frequency (%)
100	124	0.7%
98	1	< 0.1%
97	2	< 0.1%
96	2	< 0.1%
95	2	< 0.1%
94	4	< 0.1%
93	57	0.3%
92	4	< 0.1%
91	4	< 0.1%
90	3	< 0.1%

ACF and PACF

dewpt
Numeric time series

HIGH CORRELATION NON STATIONARY SEASONAL

Distinct	374
Distinct (%)	2.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	11.915911
Minimum	-17.1
Maximum	26.7
Zeros	34
Zeros (%)	0.2%
Memory size	273.0 KiB

Quantile statistics

Minimum	-17.1
5-th percentile	-0.4
Q1	6.8
median	12
Q3	17.9
95-th percentile	22.5
Maximum	26.7
Range	43.8
Interquartile range (IQR)	11.1

Descriptive statistics

Standard deviation	7.1647674
Coefficient of variation (CV)	0.60127735
Kurtosis	-0.627254
Mean	11.915911
Median Absolute Deviation (MAD)	5.6
Skewness	-0.30010491
Sum	208194.8
Variance	51.333893
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	0.001236149463

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
18.9	111	0.6%
11.3	109	0.6%
9.3	109	0.6%
20	105	0.6%
18.4	103	0.6%
11.4	102	0.6%
9.4	102	0.6%
18.2	101	0.6%
8	101	0.6%
10.6	100	0.6%
Other values (364)	16429	94.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-17.1	1	< 0.1%
-16.6	1	< 0.1%
-15.1	1	< 0.1%
-14.8	1	< 0.1%
-14.6	1	< 0.1%
-13.7	1	< 0.1%
-13.3	1	< 0.1%
-13.1	1	< 0.1%
-13	1	< 0.1%
-12.9	1	< 0.1%

Value	Count	Frequency (%)
26.7	1	< 0.1%
26.5	1	< 0.1%
26.3	1	< 0.1%
26.2	1	< 0.1%
25.9	1	< 0.1%
25.8	5	< 0.1%
25.7	1	< 0.1%
25.6	1	< 0.1%
25.5	7	< 0.1%
25.4	5	< 0.1%

ACF and PACF

rh
Numeric time series

NON STATIONARY SEASONAL

Distinct	88
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	68.606685
Minimum	10
Maximum	98
Zeros	0
Zeros (%)	0.0%
Memory size	273.0 KiB

Quantile statistics

Minimum	10
5-th percentile	44
Q1	60
median	70
Q3	79
95-th percentile	88
Maximum	98
Range	88
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	13.602779
Coefficient of variation (CV)	0.19827192
Kurtosis	0.17172151
Mean	68.606685
Median Absolute Deviation (MAD)	9
Skewness	-0.6054697
Sum	1198696
Variance	185.03561
Monotonicity	Not monotonic
Augmented Dickey-Fuller test p-value	2.056967976 × 10^-21

Histogram with fixed size bins (bins=50)

Gap statistics

number of gaps	1
min	1 day and 1 hour
max	1 day and 1 hour
mean	1 day and 1 hour
std	0

Value	Count	Frequency (%)
72	567	3.2%
73	549	3.1%
75	537	3.1%
69	520	3.0%
67	498	2.9%
68	496	2.8%
76	496	2.8%
66	490	2.8%
78	484	2.8%
71	479	2.7%
Other values (78)	12356	70.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
10	2	< 0.1%
11	1	< 0.1%
12	1	< 0.1%
13	2	< 0.1%
14	4	< 0.1%
15	1	< 0.1%
16	3	< 0.1%
17	5	< 0.1%
18	2	< 0.1%
19	5	< 0.1%

Value	Count	Frequency (%)
98	3	< 0.1%
96	12	0.1%
95	15	0.1%
94	39	0.2%
93	52	0.3%
92	87	0.5%
91	129	0.7%
90	155	0.9%
89	260	1.5%
88	260	1.5%

ACF and PACF

Auto

Heatmap
Table

	clouds	dewpt	dhi	dni	ghi	rh	temp	wind_spd
clouds	1.000	0.035	-0.021	-0.021	-0.022	0.235	-0.065	0.022
dewpt	0.035	1.000	0.192	0.186	0.199	0.316	0.893	-0.109
dhi	-0.021	0.192	1.000	0.999	0.999	-0.404	0.385	0.330
dni	-0.021	0.186	0.999	1.000	0.999	-0.404	0.380	0.330
ghi	-0.022	0.199	0.999	0.999	1.000	-0.403	0.392	0.328
rh	0.235	0.316	-0.404	-0.404	-0.403	1.000	-0.106	-0.254
temp	-0.065	0.893	0.385	0.380	0.392	-0.106	1.000	-0.001
wind_spd	0.022	-0.109	0.330	0.330	0.328	-0.254	-0.001	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	timestamp_local	temp	wind_spd	dhi	ghi	dni	clouds	dewpt	rh
2022-01-01 00:00:00	2022-01-01 00:00:00	10.7	1.0	0	0	0	87	9.5	92
2022-01-01 01:00:00	2022-01-01 01:00:00	10.7	2.6	0	0	0	62	8.8	88
2022-01-01 02:00:00	2022-01-01 02:00:00	10.7	2.6	0	0	0	87	9.0	89
2022-01-01 03:00:00	2022-01-01 03:00:00	10.2	2.6	0	0	0	68	8.5	89
2022-01-01 04:00:00	2022-01-01 04:00:00	10.5	1.5	0	0	0	75	9.3	92
2022-01-01 05:00:00	2022-01-01 05:00:00	10.5	1.5	0	0	0	87	8.4	87
2022-01-01 06:00:00	2022-01-01 06:00:00	10.5	2.6	0	0	0	62	9.6	94
2022-01-01 07:00:00	2022-01-01 07:00:00	10.0	1.0	0	0	0	37	9.1	94
2022-01-01 08:00:00	2022-01-01 08:00:00	8.0	1.5	0	0	0	56	6.5	90
2022-01-01 09:00:00	2022-01-01 09:00:00	8.6	1.0	39	64	340	87	7.7	94

	timestamp_local	temp	wind_spd	dhi	ghi	dni	clouds	dewpt	rh
2023-12-30 14:00:00	2023-12-30 14:00:00	15.2	2.10	87	382	745	33	7.0	58
2023-12-30 15:00:00	2023-12-30 15:00:00	14.2	3.60	79	298	686	35	8.8	70
2023-12-30 16:00:00	2023-12-30 16:00:00	14.0	3.60	62	176	559	37	9.0	72
2023-12-30 17:00:00	2023-12-30 17:00:00	13.2	4.09	32	41	259	0	9.3	77
2023-12-30 18:00:00	2023-12-30 18:00:00	12.2	3.60	0	0	0	0	8.9	80
2023-12-30 19:00:00	2023-12-30 19:00:00	11.2	2.10	0	0	0	0	7.5	78
2023-12-30 20:00:00	2023-12-30 20:00:00	10.7	2.60	0	0	0	0	6.5	75
2023-12-30 21:00:00	2023-12-30 21:00:00	10.7	3.10	0	0	0	0	6.6	76
2023-12-30 22:00:00	2023-12-30 22:00:00	10.6	4.59	0	0	0	0	6.6	76
2023-12-30 23:00:00	2023-12-30 23:00:00	7.7	1.00	0	0	0	0	5.3	85

Overview

Variables

Interactions

Correlations

Missing values

Sample